Areca: Online Comparison of Research Results

To experiment properly, scientists from many research areas need large sets of real world data. Information retrieval scientists for example often need to evaluate their algorithms on a dataset or a gold standard. The availability of these datasets often is insufficient and authors with the same goal do not evaluate their approaches on the same data. To make research results more transparent and comparable, we introduce Areca, an online portal for sharing datasets and/or the results that were reached with the author’s algorithms on these datasets. Having such an online comparison makes it easier to grasp the state-of-the-art on certain tasks and drive research to improve the results.